Load balancing for Key Value Data Stores

نویسندگان

  • Ainhoa Azqueta-Alzúaz
  • Ivan Brondino
  • Marta Patiño-Martínez
  • Ricardo Jiménez-Peris
چکیده

In the last decade new scalable data stores have emerged in order to process and store the increasing amount of data that is produced every day. These data stores are inherently distributed to adapt to the increasing load and generated data. HBase is one of such data stores built after Google BigTable that stores large tables (hundreds of millions of rows) where data is stored sorted by key. A region is the unit of distribution in HBase and is a continuous range of keys in the key space. HBase lacks a mechanism to distribute the load across region servers in an automated manner. In this paper, we present a load balancer that is able to split tables into an appropriate number of regions of appropriate sizes and distribute them across servers in order to attain a balanced load across all servers. The experimental evaluation shows that the performance is improved with the proposed load balancer.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Achieving Data-Aware Load Balancing through Distributed Queues and Key/Value Stores

Load balancing techniques (e.g. work stealing) are important to obtain the best performance for distributed task scheduling system. In work stealing, tasks are randomly migrated from heavy-loaded schedulers to idle ones. However, for data-intensive applications where tasks are dependent and task execution involves processing large amount of data, migrating tasks blindly would compromise the dat...

متن کامل

Key-value store cluster with programmability in NICs and switches CSE551 Final Report

Today’s data center applications such as key-value stores generally run on multiple servers and on multiple cores for each sever in order to be able to handle the request loads. As a consequence, a steering and load-balancing decision needs to be made for each request about which server and core it should be handled by. Table 1 provides an overview of common approaches to load balancing, and ho...

متن کامل

Passive/Active Load Balancing with Informed Node Placement in DHTs

Distributed key/value stores are a basic building block for large-scale Internet services. Support for range queries introduces new challenges to load balancing since both the key and workload distribution can be non-uniform. We build on previous work based on the power of choice to present algorithms suitable for active and passive load balancing that adapt to both the key and workload distrib...

متن کامل

LogKV: Exploiting Key-Value Stores for Log Processing

Event log processing and analysis play a key role in applications ranging from security management, IT trouble shooting, to user behavior analysis. Recent years have seen a rapid growth in system scales and the corresponding rapid increase in the amount of log event data. At the same time, as logs are found to be a valuable information source, log analysis tasks have become more sophisticated d...

متن کامل

LogKV: Exploiting Key-Value Stores for Event Log Processing

Event log processing and analysis play a key role in applications ranging from security management, IT trouble shooting, to user behavior analysis. Recent years have seen a rapid growth in system scales and the corresponding rapid increase in the amount of log event data. At the same time, as logs are found to be a valuable information source, log analysis tasks have become more sophisticated d...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017